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[57] ABSTRACT 

An expert system and processing method employing a three 
level hierarchical knowledge base that has a plurality of 
nodes coupled together. An uppermost level comprises a 
behavioral knowledge level, a middle level comprises a 
structural knowledge level and a lowermost level is an 
action level. Inference processing proceeds from the behav- 
ioral knowledge level through the structural knowledge level 
to a leaf node of the action level. One or more non- 
inferentially assessable utilities may be associated with the 
inference kernel of the expert system for accessing during 
inferential processing within the hierarchically structured 
knowledge base. A knowledge editor implements guidelines 
that structure received information in the desired hierarchi- 
cal three level configuration. Further, interactive 
multimedia/hypennedia systems and methods are presented, 
which might be expert system based. Training and certifi- 
cation applications of the multimedia/hypermedia system/ 
method are given. 
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EXPERT SYSTEM AND METHOD It is also recognized that rule-based systems become 

EMPLOYING HIERARCHICAL increasingly difficult to understand and maintain as the 

KNOWLEDGE BASE, AND INTERACTIVE number of rules grow. While a reasonable rule-based expert 

MULTIMEDIA/HYPERMEDIA system shell can assist a domain expert in formulating 

APPLICATIONS 5 cause-and-effect rules, a collection of such rules typically 

will not function as an expert system, except for the most 

CROSS-REFERENCE TO RELATED simple cases, lb overcome these limitations, some expert 

APPLICATIONS system shells allow the encoding of strategic and object- 
level knowledge as meta-rules. However, this requires 

This Application is a division of U.S. patent application extensive knowledge of the programming paradigm and the 

Ser. No. 08/235,301 filed Apr. 29, 1994, now U.S. Pat. No. development environment. Another class of tools provides a 

5 644 686. search algorithm for a flat problem-space representation. 

Although the problem representation is simplified, the 

TECHNICAL FIELD search complexity for a problem of solution length L> and a 

search space branching factor B has a worst case complexity 

The present invention relates in a first aspect to expert 15 OfB^). 

systems, and in particular, to a domain independent expert As an alternative, it has been suggested that it is actually 

system and method employing inferential processing within more fruitful in certain domains to concentrate on construct- 

a hierarchically-structured knowledge base and non- ing models of belief organization for diagnosis rather than 

inferential accessing of information within one or more models of physical entities. The concept of belief potentially 

associated utilities. In another aspect, the invention relates to 20 has a wider scope than explicitly defined knowledge. A 

a unique hierarchical structure for representing information method of organization of beliefs has been proposed for 

in a knowledge base for access by an inference kernel and diagnostic problems that provides explicit belief organiza- 

to a knowledge editor for facilitating development of such a tion with implicit organization of knowledge about physical 

knowledge base by a domain expert. In still another aspect, device characteristics, functionality, and behavior. The 

the invention relates to interactive multimedi a/hypermedia 25 method is claimed to provide ire asoning about belief among 

systems and methods, particularly for training and certifi- alternatives, is extensible and can be scaled to problem size^ 

cation a lications Further, it is asserted that belief manipulation coupled with 

ca on app ca ons. information about fault history, events, and symptoms is 

BACKGROUND ART sufficient to secure a good diagnostic result. The approach 

30 presented herein modifies and combines behavioral knowl- 

CIM (computer-integrated manufacturing) is viewed as an edge presentation with structural knowledge presentation to 

emerging technology in the domain of manufacturing. The identify a recommended action. 

concept of CLM is that the whole performs better than the It has long been recognized that hierarchical problem 

sum of the individual parts. In order to make a system run solving can be used to reduce search space within an expert 

smoothly with minimum delay (i.e., continuous flow s system. It has been shown that the complexity of search 

manufacturing) it is necessary to have a diagnostic system space for a problem of solution length and search space, 

for discovering any cause of system failure. It is desirable branching factor <B\ isreduced from 0(&) for single-level 

that this diagnostic system be capable of performing its ask representaUon, to Ojvp B^ for two-level representation, 

as fast as possible since the duration of the system's down « d <° °0) mulU-kve i representauon Tois analysis as 

r 1 , i * j * j * * * ji * based on the assumption that the abstraction divides the 

Ume is very closely related to productivity and cost. ^ problcm ^ 0(L ) constant size problems that can be solved 

Thereby, there is aneedfor intelligent diagnostic systems. In £ q ^ acktracki T [ can be shown th at eV en in 

artificial intelligence and expert systems, diagnosis has been domains ^ do no{ satisfy the aesampdgmt ^ use of 

given more attention in recent years, including trouble- hierarchical problem solving still produces significant 

shooting in electronic circuits and medical diagnosis, reductions in search space. Hierarchical problem solving 

There have been a variety of approaches taken by various 45 and knowledge processing techniques have been used in 

researchers for creating intelligent diagnostic expert sys- several reported expert systems. Hie concepts presented 

tems. These approaches range from shallow reasoning using herein provide enhancements over such prior techniques, 

compiled rules to model-based deep reasoning systems that Experienced engineers, technicians, and system operators 

reason by exploiting causal, structural, and functional rela- typically develop their own diagnostic flowcharts, proce- 

tionships. Some approaches even combine shallow and deep 50 dures and shortcuts over time. Such materials are utilized 

knowledge reasoning. It has been hypothesized by some that during daily activities, and only occasionally do such indi- 

the use of deep representations of entities to be diagnosed is viduals refer to basic principles and documented diagnostic 

superior to empirical knowledge about associations between procedures to solve problems. This has been a natural 

malfunctioning parts of an entity and symptoms. The ratio- response to the large volume of maintenance and operation 

nale for such a conclusion is that one could not exhuastively 55 manuals offered by tool vendors and process developers of 

catalog all such associations, and without such a catalog, a a manufacturing enterprise. Further, the majority of exper- 

heuristic-based diagnostic system becomes brittle and fails tise accumulated by technicians and operators is usually not 

when presented with a case that it does not understand. shared among different teams and can be lost due to transfers 

On the other hand, deep knowledge representation is or job changes. In addition, local upgrades/modifications, 

based on models that are difficult to construct, especially 60 which might not be explained in a vendor manual, can be 

models that exhibit the technology intent of the designer. scattered among personal notebooks or other notes near the 

Further, it is unlikely that models will mirror the future machines or technician workbenches. The challenge of 

behavior of entities of any complexity, particularly with knowledge engineering in such an environment is to accom- 

regard to providing information about multiple perspectives. modate various sources of expertise and to guide and 

Moreover, models are likely to be domain specific and only 65 influence the expert toward considering all aspects of the 

some fraction of knowledge will be transferable from one environment beyond the individual's usual activities and 

diagnostic system's knowledge base to another. concerns. 
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The knowledge acquisition task is often complicated by using the most current version or whether an operator's 

the fact that human experts have not analyzed the contents training in fact covers a latest version of a processor tool 

of their thoughts, so that they are not explicitly aware of the upgrade. By making the information available on-line, posi- 

structure of their knowledge. As a result, the intermediate tive control over the information being disseminated is 

steps and the reasoning seems obvious to them and they 5 obtained. 

cannot clearly provide an overall account of how decisions Computer-based training and intelligent tutoring systems 

are made, at least not at a level of detail required for expert are typically based on a single, and rather simple user model, 

system development. There are a number of approaches to Regardless of the familiarity or lack of familiarity of the 

knowledge acquisition. The three basic approaches are tra ! nee ^ ^ <°P 1C > ^ trainees go through tb^same 

interview, interaction (supervised) and induction 10 trainmg process. Anew employe* who has never worked in 

, . ,v a similar environment is given the same training material as 

(unsupervise an em p^ oyee wno nas manv vears 0 f re i a ted experience and 

Historically, interview has been the most prevalent might have been transferred to a new assignment from a 
method of knowledge acquisition. It is, however, highly similar area. Certification and qualification procedures are 
dependent on the knowledge engineer, is often time con- usually conducted orally in an ad-hoc fashion and are 
suming and expensive, and is typically viewed as the knowl- 15 subject to a trainer's judgment and biases. In addition, there 
edge acquisition bottleneck. It is also recognized that for is no formal methodology for increasing the responsibility of 
knowledge intensive and task oriented applications, super- a trainee as the training proceeds. In order for a computer- 
vised knowledge acquisition is more efficient. Large data- aided training system to acquire the necessary flexibility, it 
base and data intensive applications are good candidates for should distinguish between several types of students and 
unsupervised knowledge acquisition. 20 structure the training material according to a student's needs 

On the other hand, many expert systems use task-oriented and background. , „ . - . 

shallow knowledge. Id knowledge acquisition it is some- Multimedia in general and motion video, animation and 

times necessary to carry out excursions into deep knowledge audi ° m particular, are believed very appealing to personnel 

in order to understand and validate associated shallow mvolv ¥ c T d 10 maintenance, diagnostics and training apphca- 

knowledge. This requires involving experts in knowledge 25 Uo f ; However in many cases a major drawbacks the cost 

acquisition, since they are in a position to understand the lo ^ lcs °f hardware and software required to imple- 

deep knowledge and its relation to the shallow knowledge. ment L such a multimedia system This is complicated by the 

In addition, studies performed on the quality, efficiency, and *^ m ° st manufacturing facilities include tens if no 

accuracy of knowledge bases have shown that knowledge b™*cds of workstations. If an application requires special 

bases developed by the expert (versus the knowledge 30 hardware and/or software hc^nsing, then cost becomes sig- 

engineer) tend to be smaller, provide larger number of nincant. 

pathways associating evidence to diagnostic hypothesis, All the above drawbacks and problems associated with 

include more critical attributes, and provide richer clusters existin g s y stems multimedia/hypermedia appli- 

of knowledge. This is another argument in favor of provid- cations are addressed by the systems and methods presented 

ing domain experts with a larger role in knowledge acqui- 35 herein. 

sition. DISCLOSURE OF INVENTION 

As a related problem, existing multimedia training appli- Briefly described, the present invention comprises in a 
cations are typically developed by a media production first aspect an expert system responsive to provided external 
specialist, and are usually delivered on read-only storage ^ information. The expert system includes a first storage 
medium (CD-ROM, video disk). Such applications exhibit means ^ a storage means. The first storage means 
huge initial start-up costs, do not provide any intelligent stores a hierarchically-structured knowledge base containing 
feedback or control, and require specialized hardware and/or inferentially processable information, while the second stor- 
software, meaning that any modification and/or upgrade will age means CO ntains at least one utility comprising non- 
be expensive and time consuming. 45 ^^^3]^ accessible information. A processor is coupled 
Manufacturing enterprises can employ hundreds and to the first storage means and the second storage means for 
sometimes thousands of permanent and temporary system processing the hierarchically-structured knowledge base and 
operators and technicians. Currently, a multitude of methods accessing the at least one utility, respectively. The process- 
are used for educating and assisting such manufacturing ing means includes means for inferential processing of 
personnel. These methods include informal, unstructured 50 information in the hierarchically-structured knowledge base 
training sessions, printed ' in- house' manuals, classroom and means for non-inferential accessing of information in 
instruction, and walk-through orientations to name but a the at least one utility. The inferential processing means and 
few. In the manufacturing environment, the student popu- the non-inferential accessing means are responsive to the 
lation grows with every group of new employees, whether provided external information. 

temporary or permanent. This student group is typically 5S j n another aspect, the invention comprises a 
large and decentralized and cannot be released from the hierarchically-structured knowledge base for an expert sys- 
manufacturing line simultaneously to attend a standardized t em. The knowledge base comprises a hierarchical decom- 
training course. position having a plurality of nodes coupled together in three 
Interactive multimedia training and certification can distinct levels. An uppermost level comprises a behavioral 
present consistent subject matter, on a flexible twenty-four 60 knowledge level, a middle level comprises a structural 
hour, seven day per week schedule. The subject matter knowledge level and a lowermost level is an action level, 
delivered to the trainee is guaranteed to be consistent, thus The action level is implemented as at least one decision tree, 
avoiding reliance on a thorough presentation of material by The three distinct levels are interconnected such that infer- 
a knowledgeable technician. Use of an on-line computer ence processing can occur through the hierarchically- 
based training methodology would eliminate a back- level 65 structured knowledge base from the behavioral knowledge 
problem. Currently, with the use of printed documents there level through the structural knowledge level to the action 
is always an uncertainty as to whether the line operator is level. 
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In yet another aspect, an intelligent system is presented heuristics practiced in resolving conflicts and unanticipated 

responsive to provided external information. The system situations, taking into consideration the practicality and 

includes memory means for storing multimedia displayable overall cost of the solution. 

information, which is non-inferentially accessible. An intel- j n a diagnostic implementation, knowledge processing 

ligent control system, coupled to the memory means, 5 provides useful information on the nature of a problem, even 

includes a hierarchically-structured knowledge base con- if the exact problem(s) remains unidentified. The knowledge 

taining inf erentially processable information and processing engineering methodology is based on supervised knowledge 

means coupled to the hierarchicaUy-structured knowledge a isition principles and provides a complete knowledge 

base. The processing means includes means for inferential engineering ^tegy directed towards a domain expert, 

processing of information m the hierarchicaUy-structured w ^ 'on ^ a Knowledge Editor provide a 

knowledge base and means for non-inferential accessing of ^ m ted eaa&m for reducing me knowledge eng i. 

the multimedia displayable informa ion in the memory ^ bottleneck ^d improving the quality of the final 

means. The means for non-inferential accessing of multi- m Devel nt and deployment of an interactive 

media displayable information is responsive to .the means for / ia tic t tem is possib i e 0D standard 

inferential processing of ^formation and the means for 15 wor | station l hcKb prov i di ng a low cost delivery 

inferential processing of information is itself responsive to la tform, as well as enabling ^ integration of mll ltimedia 

the provided external information. capabilities of graphical workstations into the diagnostic 

In a further aspect, a computer system is provided having applications 
memory means for storing multimedia dkplayable informa- ^ ented b a lete md mtegrated methodology 
tion and display means for displaying information to a user 20 ^ arcmtecture for development of intelligent interactive 
of the computer system. A processing means, coupled to the mu i tim edia/hypermedia computer-aided training/education 
memory means and the display means, includes hyper- ^ alinca ^ certincatiori applications. A control and 
graphic processmg capabilities associated with a predefined mana H t Pledge base ser ves as an intelligent tutor- 
graphics image displayable on the display means. The m famBWfA Trainin certification, and on-line 
hypergraphic processing capabilities include means for pro- s d( f cumentation databases are integrated with the knowledge 
VKhngmeuserofmec«mputersystemwimanopuonsmenu and m ment Actions developed 
upon user selection of the predefined graphics image when ^ ^ methodol and arcbite cture reside entirely on 
displayed by the display means. The options menu has at or removable/rewritable storage med ium (such ^ 
least two user selectable options each of which is linked to ^ ^ ^ ^ m or network 
a separate portion of the multimedia displayable information 30 ^5™,^^ 
stored in the memory means. Each separate portion of the ^ 

multimedia displayable information presents information to BRIEF DESCRIPTION OF DRAWINGS 

the user in a different multimedia format. These and other objects, advantages and features of the 

In a still further aspect, a method for defining a present invention will be more readily understood from the 

hierarchically-structured knowledge base for an intelligent 35 f 0 u owmg de tailed description of certain preferred embodi- 

system is presented. The method includes the steps of: mentsof the invention, when considered in conjunction with 

creating multiple knowledge trees from a plurality of nodes ^ acco mpanying drawings in which: 

and associated attributes including at least one action knowl- FIGS la lfc&lcare examples depicting the hierarchical 

edge tree, at least one structural knowledge tree, and a ^ structure of a knowledge base in accordance with the 

behavioral knowledge tree; and linking the knowledge trees « m mvention) wherein FIG. la depicts universal 

together to form a hierarchical decomposition such that the attribut e S( F i G . lb shows global attributes and FIG. lc is an 

hierarchically-structured knowledge base has three distinct example 0 f a Condition Action Tree (CAT); 

levels, an uppermost level comprising the behavioral knowl- ^ & & examples of diagnosis pursuant 

edge tree, a middle level comprising the at least one struc- nt ^ vari(ms condition action te es; 

rural knowledge Ireland a lowermost level composing the 4S * p roceS sing embodiment for defining a 

at least one action knowledge tree. knowledge tree (BHKB, SHKB, CAT) in accordance with 

Also presented is a processing method for an exp ert ^ 

s ystem responsive to e xternal .rfojm^pn .nggtej bj_a £ embodiment of a main menu screen of 

of the system. Thejroc^ me hod memdes the steps o ^ ? Editor (KE) developed in accordance with the 

lnferenfiallv processing information in a mer arxhicallY- 50 • * a a~c^„„ 

stfucS red LLledgc b^jfflEHgrSE^S^rnal present invenfaon to gwde a user in partitioning and defining 

i nf ormation ^VL^ w^^o^^ ^y^,^ a diagnostic knowledge base; 

aunSg the inferential processing, non-infeTentially access- WO. 5 is an example of a Knowledge Editor screen 

ing information in at least one predefined utility separate &cuH.Ung me definition of nodes and tar tabute .and 

frL the hierarchically-structured knowledge base. Addi- ss °° w may be linked together to define a system m 

tional methods and method enhancements are also provided accordance with the present invention, whe em both 

k ere j n template-based and visual programming capabilities ol the 

To restate, provided herein is a domain independent ^ a ' e & ^ own 'y 

expert system and processing method employing inferential FIG 6 is an example of a knowledge representation 

processing within a hierarchically-structured knowledge 60 hierarchy pursuant to the present invention; 

base in conjunction with non-inferential accessing of infor- FIG. 7 is another example of a three level hierarchy in 

mation within one or more associated utilities. Knowledge accordance with the invention, wherein structural level 

representation architecture is based on hierarchical knowl- knowledge bases are linked to terminal nodes of a behav- 

edge representation principles with a novel decision tree ioral level knowledge base, and condition action trees are 

architecture consistent with a proposed knowledge engineer- 65 linked to the terminal nodes of the structural level; 

ing methodology. Conflict resolution employs an entropic FIG. 8 depicts representation of events as time-stamped 

based approach which allows domain experts to describe the branches of corresponding condition action trees; 
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FIG. 9 is an example of a condition action tree (CAT) 
showing a root node, an entry node and various children 
□odes connected thereto; 

FIG. 10 is a flowchart of one embodiment of inferential 
knowledge base processing by an inference kernel in accor- 5 
dance with the present invention; 

FIG. 11 is a perspective view of a computer system upon 
which an expert system and/or a multimedia/hypermedia 
system in accordance with the present invention may be 
implemented; 10 

FIG. 12 is a block diagram representation of possible 
component overlaps of both an expert system and a 
multimedia/hypermedia system in accordance with the 
present invention; 

FIG. 13 is an example of one embodiment of a graphical 15 
user interface window in accordance with the present inven- 
tion; 

FIG. 14 charts IBM's common user access (CUA) guide- 
lines and user interface design principles employed in a 
graphical user interface in accordance with the present 2Q 
invention; 

FIG. 15 depicts one embodiment of a graphical user 
interface window partitioning in accordance with the present 
invention; 

FIGS. 16a-16p depict standardized programmable tern- 
plates (referred to as "logical pages") proposed for use in a 
multimedia/hypermedia system in accordance with the 
present invention; 

FIG. 17 is an example of a logical page partitioning of a 
multimedia/hypermedia module employing a template of 
FIGS. 16a-l6p; 30 

FIG. 18 is an image useful in explaining hypergraphic hot 
spot functions in accordance with the present invention; 

BG. 19 is one embodiment of a logical page attribute 
menu useful in customizing logical page templates in accor- 
dance with the present invention; 1 35 

FIG. 20 is a block diagram representation of one embodi- 
ment of a knowledge-based multimedia training/certification 
system in accordance with the present invention; 

FIG. 21 is a block diagram representation of a multilevel 
training/certification user model in accordance with a mul- 40 
timedia system pursuant to the present invention; 

FIG. 22 is a display image representation useful in 
describing a hot spot pop-up menu for a hypergraphics 
implementation in accordance with the present invention; 

FIG. 23 is a flowchart of one embodiment of processing 45 
to create a hypergraphic hot spot in accordance with the 
present invention; 

FIG. 24 is a flowchart of one embodiment of processing 
to create a hypergraphic function pop-up menu in accor- 
dance with the present invention; 50 

FIG. 25 is one embodiment of a main menu of a "poor 
man's video" (PMV) editor for authoring motion video clips 
in accordance with the present invention; 

FIG. 26 graphically depicts PMV processing in both 
run-time and compile-time in accordance with the present 55 
invention; 

FIG. 27 is a flowchart of one embodiment of compiler 
processing to create a PMV library block in accordance with 
the present invention; and 

FIG. 28 is a flowchart of one embodiment of player 60 
processing for viewing a PMV in accordance with the 
present invention. 

BEST MODE FOR CARRYING OUT THE 

INVENTION 65 
Various terms used herein will first be explained. "Diag- 
nosis" is defined as inferring system malfunctions from 



g 

observable elements, factors, or circumstances or identify- 
ing the proper association between symptoms and their 
causes. In other words, diagnosis is the process of finding the 
location and nature of a system malfunction and even 
suggesting a remedy. A "system" is defined as a complex of 
interacting objects that have some process behavior. The 
following are examples of systems: a VLSI chip; a computer 
program; a manufacturing tool or machine (e.g., wafer 
polisher, oxide growth furnace, etc.); a manufacturing 
group; and a human. 

By way of example, a semiconductor manufacturing 
process will be discussed herein. In a semiconductor fabri- 
cation environment, a "malfunction" can be an error in a 
computer program, a defect in a VLSI chip, an incorrect 
specification of a manufacturing recipe, a failure of a manu- 
facturing tool to function properly, etc. A "symptom" of a 
malfunction is observed when the system behaves in a way 
that is not expected. In other words, a symptom is a 
discrepancy between observed, or actual behavior, and an 
expected, or predicted system behavior. A symptom is an 
observable condition which indicates an abnormal behavior 
or a possible malfunction. Hence, when a symptom exists, 
there must be a condition (fault) which causes the symptom. 
A "condition" is an underlying, invisible, real problem. A 
symptom on the other hand, is a visible manifestation of one 
or more conditions), i.e., evidence of a condition(s), such as 
a tool malfunction or a system error message. Diagnosis 
therefore means identifying the conditions after observing or 
indirectly detecting the symptoms. An "initiative" is an 
action or a set of actions necessary to recover from a 
malfunction, or a set of actions (operations) that will trans- 
form a system to a desired state. 

Asnoted initially, experienced engineers, technicians, an d 
operators usually develop their own dia gnostic nowc harts, 
p rocedures, and shortcuts over tne years, j ney ^utdizethese 
during L their daily a ct ivities a nd only occasionally reier to 
b asiF principles of documented diagnostic proced ures to 
so lve problems. This has been a natural response to the larg e 
v olume of maintenance a nd operation manuals o tte red by 
tool ven dors and^rocess developers of a manufacturi ng 
en tgrprfceT '1 he maiority ol tne expertise accumulated by 
tec hnicians and operators is usually not shared amo ng 
different tea ms and can be lost due to transfers or other j ob 
changes. In addition, loca l upgrades and modi fications 
(which do not end up in trie vendor man uals; can "be 
scattered among personal noteb ooks, notes on the machines, 
and technicians' workbenches. The challenge of knowledge 
engineering in such an environment is to accommodate 
various sources of expertise and to guide and influence the 
expert toward considering all aspects of the environment, 
including those beyond the individual's activities and con- 
cerns. This is necessary for eliciting complete and accurate 
knowledge and associated reasoning strategies. 

There are a number of approaches to knowledge acqui- 
sition. However, the three basic approaches are: 

1) Interviewing; 

2) Supervised interaction; and 

3) Unsupervised induction. 

Historically, interviewing has been the most prevalent 
method of knowledge acquisition. It is however highly 
dependent on the knowledge engineer, and is often time 
consuming and expensive. It is also recognized that for 
knowledge-intensive and task-oriented applications, knowl- 
edge acquisition by supervised induction is more efficient 
than interviewing or unsupervised induction. Large database 
and data-intensive applications are good candidates for 
unsupervised knowledge acquisition. 
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The construction of a knowledge base is currently a and more responsibility for development and maintenance of 

bottleneck in the development of AI systems. This is because the expert system. Each of these steps is described in detail 

it usually involves interviews with an expert, analysis of the below. 

interview records and protocols, and then formulation of the System development begins by meeting with the 

decision rules. Thus, the knowledge acquisition problem is 5 technicians, operators, and managers responsible for the 

time-consuming and does not always guarantee the validity tool, process, or task being considered for expert system 

of the rules obtained. An important method to overcome implementation. Each group is asked to list what they 

these problems is to employ inductive learning from perceive to be the problems, time consuming tasks, and 

examples. With this approach, the expert is asked to provide shortcomings of their interaction and involvement with the 

good examples and counter examples of decisions, rather 10 tool or process, and why they perceive each to be a problem, 

than to formalize his knowledge in terms of decision rules. shortcoming, or waste of time. 

These examples are then processed by the knowledge engi- The above groups are then asked to explain how they 

neer or by a computer to produce decision rules. presently handle and manage the described problems. To 

The knowledge acquisition task is often complicated by gam insight into the nature of the problem(s) and to help 

the fact that human experts have not analyzed the contents ^ explain all aspects of the problem(s) and the environment, 

of their thoughts, so they are not explicitly aware of the the following questions can serve as an outline for the 

structure of their knowledge. As a result, the intermediate discussion: 

steps in their reasoning seem obvious to them but they What are the short cuts? 

cannot clearly provide an overall account of how their Row often do m deal ^ tfaese blems? 

decisions are made, at least not at the level of detail required 20 TT JL u n , u ji *u ui o/ m 

c ^ * It t * How they would like to handle the problem? (provide a 

for expert system development. . * r v 

On the other hand, many expert systems typically use wish s ' 

task-oriented shallow knowledge. Notwithstanding this, in How would they change their work environment if they 

knowledge acquisition it is sometimes necessary to carry out nad tne necessary resources? 

excursions into deep knowledge in order to understand and 25 Wnv would they make such changes and modifications? 

validate the associated shallow knowledge. This tradition- What is the return on investment for their organization? 

ally requires involving experts in knowledge acquisition, What is the effect of changes on the product quality, cost, 

since they are in a position to understand the deep knowl- and turn-around-time? 

edge and its relation to shallow knowledge. In addition, xh e nex t step is to follow the technicians or operators for 

studies performed on the quality, efficiency, and accuracy of 30 a f ew hours a day, for a few days, and just watch them do 

knowledge bases have shown that knowledge bases devel- their jobs. This is very helpful in understanding the com- 

oped by a domain expert (rather than by a knowledge plexity and logistics of their jobs and the different sources of 

engineer) tend to be smaller, provide a larger number of d a t a they need to access. Many cases involve a lot of 

pathways linking evidence to diagnostic hypothesis, include walking around the manufacturing floor to review manuals, 

more critical attributes, and provide richer clusters of knowl- 35 to check the maintenance log, or to consult with other 

edge. Ibis is another argument in favor of providing experts technicians for help and suggestions. In some cases main- 

with a larger role in knowledge acquisition. tenance logs have to be checked to determine the last time 

Considering the above difficulties, the nature of applica- a component was changed, a specific service performed on 

tions targeted, by the present methodology, and an overall a tool, or a process was modified. 

goal of enabling the domain expert to develop the diagnostic 40 Xh e next step is to closely observe the experts as they 

application, a supervised knowledge acquisition methodol- perform diagnosis. They should be asked to explain and talk 

ogy geared toward domain experts is proposed herein. This about what they are doing as they go through the diagnosis, 

methodology is comprised of two stages, namely: This involves giving the expert a problem to solve and 

A) Compile, organize, partition, and document the knowl- letting him/her talk out loud as the problem is solved. The 
edge and associated reasoning processes according to 45 expert may not feel comfortable with this process at first, but 
predefined guidelines (explained below); and it can be explained that you just want to learn how a problem 

B) Use the Knowledge Editor software tool (presented is approached, and that will enable you to understand their 
below) for knowledge entry and verification, style and capture their expertise. As the individual continues 

The two stages of the present approach are accomplished with the diagnosis, their comments, explanations, and jus- 

in four steps. The first step is educating and familiarizing the 50 tifications should be documented. Comments such as "I am 

potential user with the capabilities and limitations of the going to check the vacuum pressure," "I just want to make 

knowledge-based system (KBS) and multimedia technology sure there is no vacuum before I test the vacuum switch," 

(discussed below). This step includes establishing a two- "I'd better turn off the main valve before I check the water 

way communication channel. In the second step, the user filter," or "I have to be careful when checking these 

environment is analyzed to identify the potential areas and 55 connections — they are high voltage" are very helpful in 

tasks suitable for KBS implementation. In the third step, capturing the structure of the expert's troubleshooting 

basic principles of developing and utilizing the KBS and methodology, diagnostic knowledge, and reasoning process, 

multimedia technology pertaining to users' domains are The following guidelines and procedures, in conjunction 

described and documented as a set of easy-to-follow guide- with the Knowledge Editor, serve to induce and capture 

lines and procedures. These guidelines and procedures are 60 complete and accurate knowledge of the reasoning strategy, 

focused on problem identification, partitioning, and the heuristics involved in the process. These guidelines 

organization, and documentation, and are considered an cover three important aspects of knowledge engineering: 

integral part of the architecture. Tney provide a supervised knowledge identification, documentation, and refinement. In 

knowledge acquisition methodology consistent with the particular, guidelines 1-9 deal with identifying various 

proposed knowledge representation and diagnostic reason- 65 knowledge modules and the relationships among these mod- 

ing architecture in accordance with the present invention. ules. Guidelines 10-19 address efficient and complete docu- 

And finally, the user is gradually encouraged to take on more mentation of knowledge, while guidelines 20-27 concern 
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refining the knowledge identified and documented in the 16) On arcs connecting a node to its children nodes, write 

previous two stages for mapping to the representation archi- down the condition under which the branch is valid (e.g. 

tecture and inference algorithm suitable for interactive diag- Yes, No, >100, <=Max Spec Limit, etc.). These corre- 

hosis in accordance with the present invention. There are spond to possible responses to the questions being asked 

several techniques available to knowledge engineers for 5 or measurements made, etc. 

improving validation and verification. Articles in the avail- 17) Assign a node strength (NS) to each node, representing 

able literature discuss exhaustive testing, case-based testing, your belief that the node would be the proper diagnosis 

formal specification, functional programming, critical (option, symptom) for the parent node. Let 2NS=1 for all 

testing, mutation testing, and reliability. Finally, the knowl- children of a node. 

edge validation methodology described in steps 28-30 is a 10 18) Assign a node cost (NQ to each node, representing the 

combination of exhaustive, case-based, and critical testing relative cost (dollar, time, manpower, resources) of 

methods. performing, testing, or verifying the conditions, tests, and 

Identify Knowledge Modules actions described at the node (O^NCil). 

1) Identify and list all tasks involved 19) For each node, determine the most useful and meaning- 

2) Identify and list all sub-tasks in each task. Tasks should 15 ful order for sorting and presenting all its children nodes, 
be partitioned at a point where either there is a pause in (Node Rank, NR= 1,2,3, . . .. , 99.) 

the scenario or the nature of the procedure changes. In Refine Knowledge Modules 

addition, try to identify meaningful partitioning criteria 20) Identify the source of answers or data for each node, 

related to the task, tool, or the environment. Should the user be prompted for the answer, should the 

3) List features common to all tasks and sub-tasks 20 data be extracted from a file, or should a database be 
(Universal attributes) (FIG. la), queried? 

4) List unique features of each task and sub-task (Global 21) Can the value of a node attribute change during diag- 
attributes). nosis or is it fixed once assigned? For example, if "tool_ 

5) List all different ways a task or sub-task can be identified, id" is fixed, there is no need to ask for its value every time 
scheduled, or performed. 25 it is encountered during the diagnosis. Whereas, 

6) List all known causes of or reasons for a task or a "pressure," "temperature," or "voltage" can change and, 
sub-task. therefore, the most recent values should be obtained each 

7) Make an ordered list of the steps involved in each task and time encountered during the diagnosis. 

sub-task. 22) What type of data should be expected for a question 

8) If a sub-task includes more than 20 steps, see if it can be 30 (character, integer, real)? 

partitioned. 23) How should the question be presented to the user? 

9) Generate a high level flowchart of the tasks and sub-tasks Should the user be presented with the question and an 
(FIG. lb), ordered list of possible answers to select from? Should the 

Document Knowledge Modules user be presented with a free format data entry panel? 

10) Generate a Condition Action Tree (CAT) (discussed 35 Should the user be told what is the valid range or type of 
below) for each sub-task (FIG. lc). Use solid arcs to answer? 

represent strong links and dotted arcs for weak links 24) Clarify the questions, actions, and measurements asso- 

(FIGS. 2a-2c). Weak links can represent "maybe " ciated with each node in more detail, so a person not 

"possible," "something to keep an eye on," or "the last familiar with the environment can understand (WHAT), 

recourse, in case all other options fail." 40 These textual descriptions will be available to users as an 

11) Name the root node of each CAT according to the explanation or clarification of prompts and system dia- 
problem which it represents. The root node is where all logues. 

universal and global . attributes are defined. These 25) Describe the reasons, importance, and relevance of each 

attributes are valid throughout the diagnosis (universal) or node to its parent node (WHY). Whenever the user 

throughout a problem (global). Local attributes (valid for 45 requests an explanation of and reason for an action 

a node) are denned at the individual nodes. In addition, all recommended by the system, the system will present the 

initial preparations and checkings are done at the root. information associated with the current node's WHY 

The root node leads to a single node (entry node), as attribute. 

shown in FIG la. This is the beginning of a task or a 26) Compile a list of services required at each step during 

sub-task CAT. If there is recursion in the process, it 50 the diagnosis (e.g., display images, play audio or 

returns to this node, not the root node (see FIGS. 2a-2c). \ ariimation, show slide show, present textual or graphics 

12) Name each sub-task after its parent task. For example, information, etc.). 

if the task is "robotic arm movement problems," then 27) Enter the data compiled in previous steps via the 

sub-tasks could be "arm does not move up," "arm does Knowledge Editor. First define nodes, then CATs, then 

not move clockwise/* "arm does not move counter 55 problems, and finally the system behavior and the prob- 

clockwise " "arm does not stop," etc. lem hierarchy. Assign user prompt, WHAT, WHY, NS, 

13) Complete and expand the CAT by writing down the NC, NR, global and universal attributes, input source(s), 
condition(s) to be tested at each node, the question(s) to and services (e.g., show pictures, play video, motion or 
be asked, the action(s) to be performed, and service(s) to animation, generate and present charts, etc.) for all nodes, 
be provided. Each node represents a decision, an 60 Knowledge Verification 

inspection, an action, or a measurement. 28) Verify the knowledge bases and export to a general 

14) Give each node a meaningful name which indicates the purpose classification or decision network expert system 
actions carried out at that node. For example, "is_ shell. Knowledge modules are checked for syntax 
vacuum_ok?," or "chk_bouse„air_pressure." This will violations, conflicts, and clashes via a Knowledge Editor 
facilitate knowledge base development and verification. 65 verification utility, discussed below. 

15) Write comments, extra instructions, warnings, things to 29) Simulate the application one task at a time. If a problem 
look for, exceptions, etc., outside of the node. is discovered, repeat the above steps, export, and simulate 
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to verify. The diagnostic application and the knowledge visual programming environment for defining knowledge 

bases can be evaluated through offline simulation and bases. The template-based approach (shown in the upper 

interactive simulation. In the offline simulation, the diag- right corner of FIG. 5) might be more suitable for developers 

nostic episodes are randomly generated and entered into with a mainframe background who feel more comfortable 

the system in the batch mode. The output is either 5 with text-based application development environments, 

evaluated manually or stored in a database for analysis. In Graphical knowledge entry, on the other hand, is suitable for 

the interactive mode, the knowledge engineer, the end- users who are familiar with graphical workstations and feel 

users and the experts run sample diagnostic cases and comfortable with using a mouse. In either case, the KE 

evaluate the system recommendations for accuracy and preferably provides a seamless interface and enables an 

completeness. The interactive simulation should also 10 application developer to move back and forth between these 

include new users performing a set of diagnostic scenarios two development environments, 

both the traditional way (referring to manuals, calling As briefly noted, there have been a variety of approaches 
experts or maintenance technicians, etc.) and using the taken by various researchers to attempt to understand me un- 
developed system, and then comparing the two ods for creating intelligent diagnostic systems. These range 
approaches. 15 from rule -based ("shallow*') systems consisting of IF-THEN 
30) Finally, simu late the entire process and fi eld test the production rules that are highly domain-specific, to model- 
Ipplication. Field testing the system should als o be based ("deep") systems that reason by exploiting causal, 
vjgwja Las a stage i n the system verification and testing. A structural, and functional relationships. Diagnosis in shallow 
t ypical s ystem will be in fieI 3 test mode lor sever al systems is fast if the symptom has been experienced and thus 
months before becoming an integral part of a manufac- 20 has been included in the knowledge base. Systems based on 
turingprocess. " deep reasoning are slower but more flexible compared to 
To enforce the above-described guidelines and to facili- shallow systems, 
tate compiling and developing knowledge bases, a Knowl- Some researchers have even combined shallow and deep 
edge Editor is provided in accordance with the present knowledge reasoning. It is hypothesized by some that using 
invention. The Knowledge Editor (KE) is developed in a 25 "deep" representations of entities to be diagnosed is superior 
suitable environment (e.g., IBM's OS/2 operating system) to using empirical knowledge about associations between 
and guides the user in partitioning and defining diagnostic malfunctioning parts of an entity and symptoms. The ratio- 
knowledge (FIG. 4). It provides panels for the user to define nale is that one cannot exhaustively catalog all such asso- 
nodes and all the corresponding attributes (questions, ciations; and without such a catalog, a heuristic-based diag- 
instructions, actions, services, NS, NC, NR). CATs are 30 nostic system becomes brittle and fails when presented with 
defined by Unking nodes (see FIG. 5), and then combined to a case that it does not understand. On the other hand, deep 
define problems, and finally problems are linked to define knowledge representation is based on models that are dif- 
the knowledge base. The Knowledge Editor performs veri- ficult to construct — especially models that exhibit the tech- 
fication and syntax checks. nological intent of the designer. Further, it is unlikely that 
One processing embodiment employing a Knowledge 35 models will mirror the failure behavior of entities of any 
Editor in accordance with the present invention is set forth complexity, particularly with regard to providing informa- 
in FIG. 3, Initially, 10 "Start," a hierarchical tree structure is tion about multiple perspectives. Moreover, models are 
begun with definition of a root node, 12 "Define Root likely to be domain-specific, and only some fraction of 
Node." The type of tree to be defined is then determined, 14 knowledge will be transferable from one diagnostic system's 
"Type Of Tree?" If at the behavioral level (BHKB), then all 40 knowledge base to another. 

universal attributes of the knowledge base are defined, 16 It is also recognized that rule-based systems become 
"Define All Universal Attributes At Root Node/' while at the increasingly difficult to understand and maintain as the 
structural level (SHKB) global attributes are defined, 18 number of rules grow. While a reasonable rule-based expert 
"Define All Global Attributes At Root Node" Otherwise, a system shell can assist a domain expert in formulating 
Condition Action Tree is defined, 20 "Define Local 45 cause-and-effect rules, a collection of such rules typically 
Attributes At Root Node." Once the type of tree is will not function as an expert system, except in the most 
established, and attributes have been assigned to nodes, then simple cases. To overcome these limitations, some expert 
a session transcript file is defined and a time stamp is system shells allow the encoding of strategic and object- 
inserted at the top of the file, 22 "Define Session Transcript level knowledge as meta-rules. This, however, requires 
File And Insert Time Stamp At Top Of File." 50 extensive knowledge of the programming paradigm and the 

Next, an entry node leading from the root node is defined, development environment. Another class of tools provides a 
24 "Define Entry Node Leading From Root Node." This is search algorithm for a flat problem-space representation, 
followed by definition of all branches and nodes until the Although the problem representation is simplified, the 
tree is complete, 26 "Define All Branches And Nodes Until search complexity for a problem of solution length L and 
Tree Is Completed; Assign Names To Nodes." Preferably, 55 search space branching factor of B has worst-case complex- 
each node is assigned a meaningful node name and a short ity 0(B^). Given the above arguments, what is the solution? 
node ID. The resultant hierarchical tree structure is then It is proposed that in diagnosis it is actually more fruitful 
tested for error, 28 "Test Tree For Error(s)," which is in certain domains to concentrate on constructing models of 
accompanied by error monitoring, 30 "Error?" If error does belief organization rather than models of physical entities, 
occur, the source of the error is identified and corrected, 32 60 The concept of belief potentially has a wider scope than 
"Identify Source Of Error And Correct." Once testing fails explicitly defined knowledge. Belief descriptions are usually 
to establish the existence of an error, the resultant tree is generalizable and flexible in application, whereas explicitly 
saved in memory, 34 "Save Tree," and processing defined knowledge has limited scope and is very brittle, 
terminates, 36 "End." In an approach in accordance with the present invention, 

Hie Knowledge Editor (KE) provides graphical as well as 65 the domain expert's knowledge about the behavior of the 

template-based knowledge entry. Graphical knowledge environment and the general information processing tasks 

entry (shown in the lower left corner of FIG. 5) provides a are represented as a Behavioral Hierarchy Knowledge Base 
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(BHKB) (see Pig. 6). Next, a number of knowledge bases an interactive diagnostic session progresses, abstract and 

representing the expert's knowledge about the physical and vague dialogue is replaced with explicit and often exact 

structural hierarchy of the environment and the specific interaction. 

information processing tasks, called Structural Hierarchy This knowledge representation does not treat time-related 

Knowledge Bases (SHKB), are linked to each terminal node 5 situations (ev ents) differently. Events ar eamply represent ed 

of BHKB. Finally, the expert's knowledge about the asso- as time-stamped branches of their corresponding CATS, a s 

ciation between symptoms, causes, functional characteris- shown in FI G. 8. The knowledge r epresentation does n ot 

tics of the environment, possible remedies, and the execu- In clude specific information on the actual date th e event 

tion of various specific tasks and procedures are represented mi ght have happened, but rat her how such an event sh ould 

as branches of the SHKB, implemented as Condition Action 10 tirtaicen i nto consideration in the diagnostic process. F or 

Trees (CATs), as shown in FIG. 7. ex aTnpIeTthe recent replacement o f a faulty component w ith 

Preferably/collective understanding about the diagnosis a goo d part should decrease the belief that the part is at fault, 

of a given fault is represented in a hierarchical fashion. This is a part of th e kno wledge base, bu t whether the part has 

Representation of knowledge as a hierarchy of networks, actu allybeen replaceTis not a part of the knowledge ba se, 

rather than by rules or models, has a three-fold advantage. 15 Sucgl of ormation may reside in tool h istor y log; o r main- 

First of all, system performance and incremental expansion t enance databases whic h could be qu eried byjhejmottjedge 

is improved by eliminating the rule-base maintenance and base. In so me cases, the diagnostic system ma y ask the user 

rule interference problems. Second, such hierarchical toverSy wh ether an ac tion has taken pla ce, and if the answer 

decomposition provides access to intermediate states and isjggTo identity and verify me date ot the act ion: 

thereby reduces the search space. Third, such knowledge 20 A Condition Action Tree (CAT) is an n-ary 5r directed, 

representation is consistent with the expert's mental model acyclic, .graph with a root N 0 and entry nodes N^, and L 

of the environment and the reasoning process. Thus, overall levels, each level having cf nodes. Each node (except a leaf 

development and maintenance effort is improved, as well as node) has n children nodes, as shown in FIG. 9. Here it is 

the predictability of the system behavior, independent of the assumed that each node has the same number of children (n), 

amount of knowledge added into the system. 25 but in reality (n) is the maximum number of children a node 

A knowledge representation architecture in accordance can have. Anode may have more than one parent, but there 

with the present invention is composed of three levels, is no notion of inheritance. For modeling simplicity, assume 

hierarchically ordered according to the principles of that a node has only one parent. The presence of a link from 

"increasing precision with decreasing intelligence," namely: upwards node A to node B expresses the logical implication 

the abstract behavioral level, performing general informa- 30 Vx. A(x) D B(x). Three attributes are associated with each 

tion processing tasks; the structural level, dealing with node: node strength NS, node cost NC, and node rank NR. 

specific information processing tasks; and the action level, The strength NS /y of node is obtained from historical data 

executing various specific tasks. and the opinions of experts, and represents the degree of 

A single knowledge base, called Behavioral Hierarchy belief or certainty that node N,, is responsible for the 

Knowledge Base (BHKB), represents the high level abstrac- 35 symptom(s) described at its parent node, N,_, i(CtfW(/V>l)) . N„ is 

tion of the problem space. The BHKB is in fact a behavioral the jth node in level i. Therefore, its parent is the (ceil(j/n))th 

representation of the concepts and hypotheses associated (ceiling of j/n) node in level i-1. It is required that 
with the problem space. A number of knowledge bases 

representing the structural hierarchy of the problem domain s ;vs i; . - i. 

knowledge are linked to each of the terminal nodes of the 40 Jml 
BHKB. These Structural Hierarchy Knowledge Bases 

(SHKB) represent more specific knowledge (hypotheses) In other words, the sum of the strength of all the children 

about the environment and can be viewed as the structure of nodes of each parent node is unity. The node strength NS t y 

the problem domain and lower level problem resolution represents a combination of an expert-defined endorsement 

methodology. BHKB, on the other hand, are generated by 45 and the historical information accumulated during use. The 

analogies drawn across domains and applications, apply to cost NC^ represents the relative cost (in dollars, time, or 

a wider class of problems, and depict abstract problem other resources) of performing, testing, and verifying the 

solving strategies. Each SHKB represents a tool, process, conditions and actions described at the node. For computa- 

process control, procedure, logistic, or service. Finally, there tional simplicity assume O^NC^l for all i and j. NC^O 

is the action level, which performs various specific tasks. 50 means no cost, time, or effort, while NC l7 =l means 

The diagnostic actions at this level are implemented as extremely costly, very time consuming, or very difficult. The 

CAIs. NR is the ranking of a node among its siblings. 

Note that diagnostic knowledge in accordance with the Each sub-task identified in the knowledge acquisition step 

present invention is represented and processed as deep is mapped to a knowledge module, implemented as a CAT. 

knowledge first (BHKB), then shallow knowledge (SHKB 55 Each node in a CAT may have one or many possible 

and CAT). The set of CATs associated with each terminal branches associated with it. Branches (child nodes) are 

node of SHKB represents explicit knowledge at the lowest sorted according to their node rank NR, which reflects the 

abstraction level. Such knowledge usually deals with the most natural, useful, and meaningful ordering of all sibling 

functional characteristics of the diagnostic process and the nodes in a group when presenting them to a user 

environment (tool characteristics, fault isolation, component 60 (NR»i,2, . . . , 999). Anode with NR»1 will appear at the top 

testing, applying a specific remedy, etc.). The tri-level, of an option list when presented to the user during the 

hierarchical partitioning and representation of the diagnostic diagnosis. Each leaf node has two attributes: "Fixed" and 

knowledge (BHKB, SHKB, or CAT), shown in FIG. 7, "Not Fixed." Fixed is the confirmation by the user that the 

enables a user to add or delete problems (SHKB), proce- solution (procedure) presented by the CAT up to that point 

dures (CAT), and/or specific instructions (nodes) easily, 65 resolved the problem. Not Fixed, indicates that the solution 

without much effect on the system. In addition, it permits did not solve the problem or produce a favorable resolution, 

interactive diagnosis at three levels of abstraction. Thus, as A node in CAT is either a question node or an action node. 
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A question node asks the user for information or verification Continuing with FIG. 10, from instruction 112 processing 

of some attributes. An action node asks the user to perform determines whether an exact match or good candidate exist 

specific actions (measurements, component or attribute test- in the ground level space, 114 "Exact Match Or Good 

ing or verification, etc.) or calls upon services to perform Candidates?" If no match exists, then processing returns to 

some actions. In addition, each node contains the following 5 the previous abstraction level to determine whether all 

information: SHKB nodes have been exhausted, 116 "SHKB 

1) Questions to be asked or tasks to be performed to confirm Exhausted?" If "no," return is made to instruction 106, while 
or disconfirm a particular symptom. if the structural nodes have been exhausted for the particular 

2) What (a clarification of questions or actions). behavioral node then processing determines whether all 

3) Why (an explanation or justification for questions or behavior nodes have been exhausted, 110 "BHKB 
actions). Exhausted?*'. Assuming that there is a partial match in the 

4) Additional information to be presented (pictures, ground level space, then the inference processor collects 
animation, video, audio). more data, 120 "Collect More Data." If more data is 

5) Services (record session log, tools maintenance log, user available, then processing returns to instruction 112, while if 
log, etc.) no additional data is available, processing determines 
A hierarchical knowledge processing algorithm in accor- 15 whether the problem has been resolved, 118 "Problem 

dance with one aspect of the present invention employs a Resolved?" Alternatively, with identification of an exact 

hierarchy of abstract problem spaces, called abstraction match at inquiry 114, processing passes to inquiry 118 

spaces, to focus a search process. Instead of attempting to directly. If the problem has not been resolved (i.e., is 

solve a problem in the original problem space, called rejected), then processing returns to inquiry 116. Once 

"ground space " the present invention first searches for a 20 reS olved, inference processing is complete, 122 "End." 

solution in the most abstract problem space to produce a Entropy is a commonly used measure for ranking infor- 

skeletal plan. This plan is then refined at successive levels in ma tion sources. It is based on the assumption that the 

the hierarchy by inserting additional operators to produce a uncertainty regarding . any variable x characterized by a 

complete sequence of ground-level operators (see FIG. probability distribution p(x) can be represented by the 

la-lc). 25 en tropy function: 

Given a problem description, the knowledge processing 

algorithm in accordance with the present invention proceeds H ^ _ _ s^Log^) 

as shown in FIG. 10. First, the given problem, 100 "Problem * 
& Domain Description," is mapped into the most abstract 

space, or "BHKB" (FIG. la), by deleting literals from the 30 Most prior approaches fail to take into consideration the cost 

initial state and goals that are relevant to the abstraction 0 f important activities associated with diagnosis such as 

space. Next, a solution is found if it exists, 104 "Exact Match verification, availability, replacement time, tool down time, 

or Good Candidates?", that solves the abstract problem, 106 etc In addition, cost is often not utilized in the first stage of 

"SHKB." Each intermediate state in the abstract plan serves reasoning, but only in shallow knowledge reasoning, 

as a goal for the sub-problems at the next level in the 35 Most en t r0 py approaches by definition do not incorporate 

abstraction hierarchy. The algorithm then solves each inter- any attribute (e.g., cost) except estimated probability. In 

mediate sub -problem using the final state of one sub- orc j er to accommodate other attributes, the entropy function 

problem as the initial state for the next sub-problem, 108 must t> e mo dified. One modified form of entropy is called 

"Exact Match Or Good Candidates?". If "no," processing "useful information," upon which the preferred entropic 

next determines whether the abstraction space has been 40 measure i s based. Given the node strength NS fy and node 

exhausted, 110 "BHKB Exhausted?". If again "no," pro- ^ NC „ ? a no de*s entropy is defined in terms of its 

cessing returns to instruction 102 where a next BHKB node children's node strengths and node costs as shown above, 

is obtained. If "yes," then from inquiry 110 processing Again, it is assumed that a node has n children and the CAT 

updates the problem or the domain description. The process nas j [ e vels. 
is repeated until the plan is refined to the ground level space 45 

(Goal, Evidence, or Solution nodes in FIG. lc), 112 "CAT." m 

With the domain knowledge encoded in the diagnostic ffy-#t/WM3- -^ ( ^^ 
knowledge modules, the diagnostic reasoning process fol- 
lows the maintenance, troubleshooting, or evaluation para- wtcrc 
digm captured in the knowledge engineering stage. Amain- 50 q z nc si 
tenance expert, for example, begins the diagnostic process ~ <t<ki ~ 
by first observing and examining the overall performance and 
characteristics of the equipment. The proposed architecture 

can duplicate this action by presenting a hierarchy of prob- f nSq+iq - 1 

lem description menus from which the user selects. As the 55 M0-i)")+l) 
user proceeds through these initial "problem identification" 

menus, the questions become more specific, and a descrip- Whenever a user does not know the answer to a question 

tion of the problem is compiled. At each step this description (unknown), or cannot select an option from a presented list 

is matched against the entry node of all resident knowledge (conflict or incomplete information), the branch with the 

modules and the user is presented with questions, data 60 lowest entropy H^NS, NC) is selected. This allows the user 

panels to be filled, multiple options from which to select, to continue with the diagnosis and be able to examine the 

option lists to rank, or tool parameters to be measured or following steps. 

examined. The system then evaluates user responses and Given a problem description (malfunction, process 

requests and identifies relevant knowledge modules or ser- problem, product problem, etc.) and a problem domain (tool, 

vices. Inference control is passed to the appropriate module. 65 process, product, control system, task, etc.), the basic cycle 

At each step, any of the service objects may be called upon of the algorithm is to find (interactively and cooperatively) 

to improve the quality of interaction. the problem domain (BHKB), problem category (SHKB), 
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problem type (CAT), and a resolution (CAT leaf node), as through a step-by-step diagnostic process. Each case is 

described above in connection with FIG. 10 and outlined preferably organized into five fields; namely, case_title, 

below. symptoms, actions, problem, and solution (described 

Step 0: Given BHKB, SHKBs, and CATs, initialize all and below). Users can query the case-base on any combination 

evaluate all entropies. 5 of keywords in any field. The case-base preferably corn- 
Step 1 : Present description of design environment, problem, prises a hypertext document and provides fuzzy search 

and symptoms to BHKB. capability based on the word root as well as wild character 

Step 2: Starting at the root, select a node in the next level and multiple word searching. In case of multiple matches, it 

which satisfies the design environment attributes opens up to the first match, with the case__title of all 

(corresponding to the level) given in Step 1. If there is no 10 matched cases displayed in a selectable list box. 

exact match, select the node with lowest entropy. Update CASEJTTLE: Problem class, group and category 

entropy list by deleting the selected node from list. This SYMPTOMS: List of all symptoms reported by the user 

node is now the root of the remaining tree. If the entropy during the diagnosis 

list is exhausted, return to Step 0. ACTIONS: List of all actions recommended or performed 

Step 3: Repeat Step 2 until a terminal node of the BHKB is 15 by the user 

reached. If there are multiple terminal nodes or PROBLEM: Final diagnosis of the real cause of the symp- 

candidates, rank them based on the entropy of the root toms 

node of the corresponding SHKB. Then activate a can- SOLUTION: The corrective actions which fixed the prob- 

didate SHKB. lem 

Step 4: Starting at the root of the active SHKB, select the 20 By way of example, FIG. 11 depicts a computer system 

node in the next level which matches the problem and upon which the expert system (and/or multimedia/ 

symptoms given in Step 1. If there is no exact match, hypermedia system) in accordance with the present inven- 

select the node with lowest entropy (update entropy list). tion can reside. This computer system may comprise an IBM 

If the entropy list is exhausted return to Step 2. PS/2 microcomputer system employing a 386 or faster 

Step 5: Repeat Step 4 until a terminal node is reached. If 25 processing chip. In addition to a hard disk and floppy disk 

there are multiple terminal node candidates, rank them drive, the computer system has a video adapter, a video 

based on the entropy of the root node of the corresponding display monitor, a keyboard and a mouse-type data manipu- 

CATs. Then activate the candidate CAT with the lowest lation device, all for user interface with the expert system. If 

root node entropy. desired, the expert system (and/or multimedia/hypermedia 

Step 6: If the problem is resolved, processing is done. Else 30 system) could be implemented on a portable system, such as 

if the solution is rejected by the user or there is an a laptop or notebook computer. 

unknown problem, and the CAT list is not exhausted, Architecture frameworks for an expert system 150 and a 
present the next CAT. If the CAT list is exhausted, update multimedia/hypermedia system 152 in accordance with the 
NS r of the terminal node of SHKB corresponding to the present invention are depicted in FIG. 12. This object- 
rejected CAT. Reevaluate entropy for all parent nodes of 35 oriented modular architecture is comprised of a collection of 
this node, until the root of the SHKB is updated. Then interacting knowledge modules and "utilities," including 
update the node strength of the corresponding terminal training modules, on-line documentation and service 
node in BHKB and reevaluate entropy for all parent nodes modules, external applications, and databases arranged 
of this terminal node, until the root of the BHKB is around an inference kernel. As used herein, a "utility" is a 
updated. Return to step 2. 40 module containing non-inferentially accessible information. 
When a CAT at a terminal node in SHKB does not As described further below, training modules are multi- 
produce a satisfactory solution, or the SHKB linked to a media applications which provide on-line training based on 
terminal node of a BHKB does not converge, the terminal user experience level (beginner, novice, intermediate, 
node strength needs to be updated to reflect this scenario. expert). The user profile database records user expertise 
Updating a terminal node strength affects all its siblings' nod 45 levels, tasks and procedures that users are certified for, 
e strengths. The heuristic described below reduces the node certification dates, and work experience histories. The user 
strength as a function of the weakest node, but keeps the sum profile database is maintained by an area administrator and 
of all node strengths unity. Once node strengths are updated, is accessed and updated by the certification modules, 
new entropies are evaluated and propagated upward to the On-line documentation provides information on processes, 
root node. 50 tools, logistics, and other aspects of the task. User guides, 
Step 0: Update NS tf of the node N tf . operational manuals, manufacturing procedures, design 
Step 1: Identify the total number of siblings (q) If N (/ is the guidelines, etc., are implemented as hypermedia documents. 

only child, return 0. Service modules provide various communication and pre- 
Step 2: Identify t he node with minimum node strength sentation services between the user and the system. These 
(NS IJt ). 55 services include displaying high resolution images, playing 
Step 3: Subtract ZoNS^/q from Ns i; (NS^NS^-Z). audio segments, playing motion video and animation, log- 
Step 4: Increase the node strength of all siblings of N 0 - by ging tool, process, and area histories, establishing session 
2/(q-l). defaults, logging user feedback, and various report printing 
In some cases, users may not want to go through a facilities. Diagnostic knowledge base modules provide the 
step-by-step diagnostic procedure, since the user may know 60 interactive multimedia tool and process diagnosis described 
what he is looking for; e.g., the problem is known, but all the above. A user accesses the inference kernel through a 
steps involved aren't. To address this situation, summaries graphical user interface. 

and conclusions are preferably generated at the end of Graphical user interfaces (GUI), multiple screen displays, 

diagnostic sessions. In addition, cases can be collected, and windowing capabilities have provided powerful possi- 

organized, and converted to an on-line hypertext case-base. 65 bilities for user interface design in recent years. Many 

Such a case-base could serve as a fast path for expert users researchers in the field of human-computer interaction and 

who know what they are looking for and do not wish to go cognitive science have extensively studied the effects and 
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requirements of such an interface environment on users as 
well as system design. With the advent of windowing and 
multiple screen displaying capability, additional issues and 
concerns have to be taken into consideration in design of 
computer user interfaces. 

The user interface is a graphical, window-based interface 
consisting of visual representations and interaction facilities 
(e.g., see FIG. 13). Interaction with the system is through a 
menu-driven, point and click interface. Manual data entry 
and typing are kept to a minimum. The user interface 
methodology is based on IBM's Common User Access 
(CUA) architecture. CUAis a set of guidelines to be used to 
design user interfaces that are easy to learn and use. The 
CUA architecture defines the workplace environment for 
programmable workstations. These guidelines are based on 
user-interface and object-oriented relations hips and have 
been supported by human factors research and usability 
testing. They specify common user-interface components 
and techniques, as well as guidelines for applying them. The 
pull-down menus and system menu are consistent with IBM 
OS/2 Presentation Manager standards and the IBM CUA 
guidelines, as shown in FIG. 13. 

The appearance of and interaction with the inter face are 
consistent throughout system applications. Menu options 
and choices are selected by double clicking. Data entry is 
performed by typing and clicking on the "OK" button or 
pressing the "Enter" key. Multiple choice selections are 
made by placing the cursor on the selection and double 
clicking on the mouse button or by pressing the "Tab" key 
to highlight the selection and then pressing the "Enter" key 
to make the selection. All user interface functions are 
accessible via the keyboard as well as the mouse (a CUA 
requirement). 

There has been a lot of research in the field of user 
interface design principles, styles, and standards. Cognitive 
and computer scientists have produced valuable and practi- 
cal user interface design principles and guideh'nes. Several 
sets of standards and guidelines have also emerged in the 
computer industry, such as IBM's Common User Access 
(CUA) guidelines and user interface design principles. 

Common User Access (CUA) describes principles, 
components, and techniques for user interface design in 
general, as applied to a variety of software products for a 
variety of operating environments. It also describes the 
process of designing a product with a CUA interface in 
particular. The CUA user interface is a graphical interface 
that incorporates elements of object-orientation, i.e., an 
orientation in which a user's focus is on objects and in which 
the concept of applications is hidden. The CUA user inter- 
face is based on principles of user-interface design, on 
object-oriented relationships, and on field experience and 
user testing. 

The CUA guidelines provide information about how the 
model on which a product is based should be conveyed to a 
user. The CUA guidelines also include specific details about 
designing and developing computer software and user inter- 
faces. Products that adhere to the CUA guidelines and 
undergo usability testing should be comparatively easy to 
learn and use. As a result, users of products with a CUA user 
interface should find the products easy to use, efficient, and 
appropriate for the tasks that users want to accomplish. With 
respect to the user interface, three models come into play: 

1. A user's conceptual model; 

2. A programmer's model; and 

3. A designer's model. 
A user's conceptual model is a mental model. A program- 
mer's model and a designer's model are explicit, and con- 
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sciously designed. Each model represents a different audi- 
ence's perspective of user interface. FIG. 14 shows a 
summary of CUA and the various interface models it sup- 
ports. 

s In addition to a consistent dialogue and interaction, the 
window structure proposed here also provides a consistent 
windowing structure. As shown in FIG. 15, the screen is 
divided into four sections. The system window (upper left) 
contains the system dialogue, action bar menus, options, 
10 textual information to be displayed to user, and the standard 
IBM Presentation Manager service icons (minimize, 
maximize, scroll up, scroll down, and system menu). The 
summary window (lower left) appears at the end of a 
diagnostic session or when a conclusion is reached. 
15 Warnings, notices, and important messages are displayed in 
the warning window (upper right) in a bright color to get 
attention. All graphics, digitized images, pictures, diagrams, 
slide shows, animations, and scanned schematics appear in 
the graphics window (lower right). If there is more than one 
20 picture to be displayed, multiple graphics windows are 
opened on top of each other with a 20 pixel oflset toward the 
center of the screen. Any graphics window can be brought 
up to the front by just clicking on any exposed part of it. All 
windows are opened and closed by the system during the 
25 session, but the user can also mimmize, maximize, or close 
any of the windows except the system window at any time. 
The exception to the above is the external application 
windows which open in the center of the screen, but can be 
moved, minimized, or maximized. 
30 Since the systems proposed herein might be used in a 
semiconductor manufacturing environment, an important 
issue in the design of the user interface is color consider- 
ations. For example, semiconductor manufacturing includes 
areas with soft yellow lighting (clean rooms), soft white 
35 lighting, and bright white lighting. Window backgrounds, 
highlightings, text, and image annotations have to be visible 
and distinguishable in all these environments. Although a 
single set of colors suitable for all occasions and all envi- 
ronments has not been found, some color combinations are 
40 more suitable for some areas. For example, multimedia 
documents with considerable textual information are much 
easier to read and focus on in clean room environments 
when the background is black, text white, and highlights are 
bold large font. In addition, human factors analysis has 
45 revealed some problems and limitations in use of colors 
which have to be taken into consideration. For example, 
many color-blind people have trouble seeing red and green. 
Some see no color at all; others cannot distinguish blue from 
purple. For these reasons, use of color for highlighting is not 
50 recommended and should be avoided. 

In designing the User Interface (UI) several other factors 
have to be taken into consideration. Most computer-based 
applications and services with which operators deal are 
either on character-based non-programmable terminals, with 
55 display of one window at a time, very little mouse use, and 
few selectable options, or are designed as character-based, 
single window (full screen) applications. So, the operators 
using the system should be empowered but not over- 
whelmed by too many choices, options, and windows, 
so Therefore some features of the UI, such as window position 
and size, can be fixed and predefined to reduce the required 
user intervention. 

Throughout the UI and application development, 
terminologies, keywords, and buzzwords known to the 
65 manufacturing personnel should be used. Such terminology 
can be compiled during meetings, interviews and/or super- 
vised interaction sessions. Terminologies, symbols, and 



03/22/2004, EAST Version: 1,4,1 



5,806,056 

23 24 

acronyms used in vendor manuals and troubleshooting this rule makes the assumption that the more a link has been 

guides can also be utilized to assure consistency with a used, the more likely it is to be useful now and in the future, 

current mode of operation and to provide a user friendly and Once node A is activated, the next path (AB, AC, or 

familiar work environment. AD, . . . ) will be affected by the strength of all possible arcs 

Documents incorporated in the diagnostic modules, as 5 (S^, S AO S^, . . . ). Arc strengths are then normalized and 

well as on-line documentation and training documents converted to node ranks. 

should provide "linguistic-based" search and match tunc- Coordinating text, graphics, and images in a multimedia 

dons. This will allow searches for words based on word root environment is very important to effective presentation and 

and "wild cards". This allows search and match for infor- management of the subject matter. The multimedia interface 

mation rather than just an exact match. This linguistic-based 10 methodology of the present invention is based on a pre- 

search and match concept exists in IBM's Book Manager defined presentation scenario and is implemented in one of 

product. In addition, a table of "linguistic hedges" can be the predefined templates. 

developed which contains lists of equivalent and similar Specifically, multimedia modules are partitioned into 

phrases and keywords. This table can be customized for 'logical pages." A logical page (e.g., FIGS. 16a-16p & 17) 

manufacturing in general, or semiconductor manufacturing 15 consists of a set of images (still, video, animation, graphics) 

in particular. and all associated description (text and audio). In other 

A user interface is considered adaptive if it changes in words, a logical page is the predefined collection of all 

some way in response to the person who is using the system. related information (text, graphics, images, audiV 

Such an interface uses information about the user's goals, instruction, animation, video clips) which can be made 

the current active objects, and the strength of association 2 rj available to the user. The appearance, format, and access to 

between these objects to dynamically order the list of panels, logical pages is preferably consistent throughout the system, 

items in a list box, or topics presented in a multimedia or Logical pages are related to each other via hypertext and 

hypermedia document (discussed below). During hypergraphic links. 

consultation, the user is presented with a list of relevant and To assure a complete and accurate display of a logical 

relative options at each step. At the beginning of the session, ^ page (regardless of how it is addressed), it can only be linked 

these lists are very high level and not very long. As the to via its primary window. A logical page, similar to a page 

session progresses and travel occurs further down the clas- of a book, may contain many different objects of interest, but 

sification tree, the number of options could be quite large. can only be opened by a call to its primary window. All other 

In some cases it becomes necessary to sort the lists windows in a page are either dependent and automatically 

presented to the user, based on likelihood of usefulness or 30 linked to the primary window or are pop-up windows which 

relevancy, and based on past experiences. Note that in are activated via hypertext or hypergraphic links. When a 

navigating through the CAT, the user might have to select primary window is opened (via hypertext link, hypergraphic 

one of several options at a node. With an unordered list, the link, selection from table of contents, external call, or as a 

user has to search and try on average N/2 options (N-total result of a search) all its dependent secondary windows are 

number of options to select from). With an ordered list it 35 opened automatically. The following is the source code for 

would take 2M/N (i.e., M/(N/2)-2M/N) as much option the logical page shown in FIG. 17. 
scrolling before the user reaches the target option (Le., the 

correct one). M is the number of options above the target 

option in the ordered list. Of course, it is assumed that :us«proc. 

w j ■ r * n > . . .< . - :docprof ctrlarea « none toe « 1 dl] =Logic_pg 

M<N/2, and in fact results reported by other researchers m ^ objectoame _ ^gkal_Page_Main' objectid - <file.c P t\ 

the field of adaptive tutoring systems and intelligent inter- :t ui e . wafer Polisher 

faces support this assumption. &l res - 10 x - left y - bottom width - 40% height - 100% group - 1 

In the present user interface methodology, the items in an r t ^ tlcbar - nonc - vcrti ^ mlc * ' ^.Polish Arm 

j j j- *\ j c j j :hnk reftype *» hd res = 11 group = 2 

option list box are ordered according to the predefined node ^ _ jight ^ m top ^ _ m% w . $Q% 

rank (NR) and node strength (NS). Node rank specifies the 4S a uto dependent 

order in which options are displayed in the list box. This reftype - hd res - 12 group « 3 

initial ordering and node strength assignment is based on a ^ de^dent ° ^ = 6 ° % ^ ° 5 ° % 

study of existing cases and feedback from experts. ^ApZJ^A^^i. 

Preferably, the system Should be able to dynamically ; P .Polish Arm rotates Carrier to (primary) :Iinkreftype = hd res « 20. 

enhance and reevaluate the node ordering, node Strength and 50 Polishing Station Platexlink. .Polish Ann lowers carrier to platen and 

eventually knowledge base ordering. In other words, a form fenmaiy) polishing begins. 

' . , , . • j • *• :p.:lini refid = wafer reftype = fn.Wafter:elink. carrier rotation speed is 

of unsupervised learning is desired based on existing programmable. . 
resolved cases. In addition, the network should be able to 

track its Utilization and adjust and reevaluate its node :h2 res - 11 ctrlarea - none hide nosearch noprint titlebar » none 

ordering and node strength according to the frequency of „ rules - none. 

. & .„ . & _ . , j * " :artwork name - •arm.bmp* linkflle - 'arm.hgl\ 

use. Assume arc AB is a section of a knowledge tree. ±2 res = 12 ctrlarea „ nonc ^ noscarch aoprint titlebar _ none 

rules = none. 



5aj I :artwork name « *airrent.bmp\ 
A :fn id - wafer. 



Sba 



Thin slice cut from a cylinder of a single-crystal silicon, upon which . 
:efn. 



„ means the degree of association between node A and B 
through arc AB. This is the link strength, or the degree of ' 



evidence or certainty that following arc AB will advance 
problem resolution toward a final solution. S^, on the other A logical page always has a text window which serves as its 
hand, refers to the backward chaining of the same event. All 65 primary window, except full screen non-textual pages 
arc strengths (S^, S^, S^, . . . ) start at 1, and are (image, graphics, audio, motion video, animation, external 
increased by one each time the nodes are selected. In essence applications) in which case the page title is considered the 
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textual window. A window can be assigned vertical and need only be given general teaching strategies and they 

horizontal scrolls, as well as title, background and fore- could produce a large number of interactions without all of 

ground colors, font style and size. It is recommended that them being explicitly programmed in advance. However, 

text windows be assigned only vertical scrolls and allow the most of these systems lack a clear representation of the 

Information Presentation Facility (IPF) compiler (marketed 5 knowledge that they are teaching. 

by IBM) to fit and wrap the text in the window. In such systems there is a mismatch between the pro- 

In addition to hypertext links, interactive multi- function gram's internal process and the trainee's cognitive pro- 

hypergraphic links are also preferably provided. Images or cesses. The trainee using CBT and ITS is usually denied any 

components in an image can be linked to other sections of chance of using his/her initiative in guiding the learning 

the document, other images, or even other documents via 10 process. The CBT and CAI strategy is "learning by being 

hypergraphic links. "Hot-spots" defined for an object or for told". However, research has shown that "learning by dis- 

an entire image are used to make the object or image covery" and "learning by doing" are in many cases more 

selectable. Each hot-spot has a function pop-up menu which effective strategies. Amain goal in the training methodology 

is selected by clicking on the object. Then a specific function described here is to reduce intimidation and to put the trainee 

is selected by clicking on the desired function button/ 15 in control of learning. Instead of sitting in a classroom 

symbol. listening to an instructor, or following an operator on the 

To accommodate various situations and to maintain con- manufacturing floor (who is usually fighting fires and the 

sistency among multimedia modules, a set of "Logical Page last thing on his/her mind is training), the trainees work 

Templates" are defined (e.g., see the partial lists of FIGS. individually on computers that combine text, high resolution 

16a-16p & 17). These templates provide consistent facilities 20 color images, graphics, audio, animation, and motion video, 

for embedding various multimedia and hypermedia utilities This environment is characterized by student sequencing 

and functions in applications. These logical page templates through course material in a self -paced manner, while being 

facilitate sharing of multimedia modules among applications monitored by the system. The goals in developing the 

and also among other similar systems developed in other proposed training methodology can be summarized as: 

parts of a company. 25 Shorten the training process. 

A complete and integrated methodology and architecture Improve the training quality, 

for development of intelligent interactive multimedia/ provide consistent traim across the board> 

hypermedia computer-aided training and certification appli- • 7 . . 

J K * ... „ 0 . . • , Produce modular and portable training courseware, 

cations in accordance with the present invention is next r H 6 . 

described (see FIG. 20). The methodology takes fall advan- 30 Effectively deliver and monitor the training objectives, 

tage of modern multimedia workstations. Hypertext, Enable domain experts to easily develop and modify 

hypergraphics, high resolution images, audio, motion video, multimedia training courseware by providing them 

and animation are technologies that in synergy are far more with architecture, methodology, and necessary tools 

useful than each by itself. The modular and object-oriented and techniques. 

architecture provides an interactive and cooperative 35 As noted initially, manufacturing lines can be serviced by 

computer-aided training and qualification development hundreds of operators, production technicians, and mainte- 

environment. The Control and Management Knowledge nance technicians. Currently, a multitude of methods are 

Bases (CMKBs) serve as an intelligent tutoring system used for educating and assisting manufacturing personnel, 

framework. A major departure of the approach described These methods include informal, unstructured training 

herein from previously reported computer-aided training and 40 sessions, printed "in-house" manuals, sit-down classroom 

intelligent tutoring systems is the seamless integration of courses, and walk-thru orientations, to name a few. In such 

training, certification, and on-line documentation with an environment, the student population grows with every 

knowledge-based control and management, group of new employees (temporary or permanent). This 

Existing multimedia training methodologies usually student group is large and decentralized. They cannot all be 

require a large initial course preparation investment and are 45 released from the manufacturing line simultaneously to take 

suitable only for relatively stable subject matters. Such a standard training course, 

applications usually require specialized, and often A majority of the process engineers, process technicians, 
expensive, hardware and software. The interactive multime- and senior operators interviewed emphasize that their major 
dia training and certification methodology presented herein concern is the heterogeneous work environment within 
is based on standard IBM OS/2 features and a set of novel 50 which they work. In addition, it is emphasized that the 
tools and techniques (described above and below), and current training and certification methodologies are often 
provides modular, easy to upgrade, customizable training inefficient and time consuming due to usual operator turn- 
modules without any additional dedicated hardware or soft- around and frequent changes in the process and tools 
ware. Applications developed under this methodology and employed. In most cases, the new operators are trained by 
architecture reside entirely on hard disk or removable/ 55 current operators and process technicians who have their 
rewritable storage medium (i.e., optical storage) and can be own styles and biases. In addition, most of the information 
used in stand-alone or network configuration. required for their regular activities are textual documents 

Traditional Computer Based Training (CBT) and (softcopy or hardcopy). 

Computer-Assisted Instruction (CAI) teach a subject by Interactive multimedia training and certification offers 

offering corrective feedback based on a large, pre-stored set 60 consistent presentation of the subject matter, on a flexible 24 

of problems, solutions and associated remedial advice. The hour per day, seven day a week schedule. The subject matter 

most noticeable problem with CBT and CAI is the amount delivered to the trainee is guaranteed to be consistent when 

of time it takes to produce effective courseware as all such a methodology is used Thus, a "Monday Morning 

possibilities need to be anticipated in advance by the author. Syndrome" is avoided, i.e., where some of the subject Latter 

Some Intelligent Tutoring Systems (ITS) have addressed 65 presented by a line technician to new hires might be a little 

this problem by providing an environment where problems sketchy or missing altogether. Using such an on-line 

are generated automatically. Such "generative" systems computer-based training methodology also eliminates the 
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back-level problem. Currently, using printed documents one closely as BeginDer and Novice users. Whenever multime- 

is never sure if a line operator is using the most current dia and hypermedia modules are accessed directly, they 

revision or whether an operator's training bad covered the provide passive training, whereas if these are presented via 

latest version of process or tool upgrades. By making the diagnostic knowledge bases or the CMKB, then active 

information available "on-line," and integrating training, 5 training is performed. 

certification and documentation, better control is obtained Computer-based training and intelligent tutoring systems 

over what information is being used and what needs to be are usually based on a single and simple student model, 

disseminated. Regardless of the familiarity or lack of familiarity of the 

The architecture presented below provides an intelligent, trainees with the topic, all go through the same training 

interactive and cooperative computer-aided training and 10 process. A new hire who has never worked in a similar 

qualification framework and can be classified as an Intelli- environment is given the same training material as the one 

gent Compute r-Aided Training (ICAT) or Intelligent who has many years of related experience and might have 

Computer-Aided Learning (ICAL) architecture. The object- been transferred to this new assignment from a similar area, 

oriented modular architecture is comprised of a collection of Certification procedures are usually conducted orally in an 

interacting and cooperating modules arranged around the 15 ad-hoc fashion and are subject to a trainer's judgment and 

Control and Management Knowledge Bases (CMKBs), as biases. In addition, there is no formal methodology for 

shown in FIG. 20. increasing the responsibility of a trainee as the training 

Training modules provide interactive multimedia training proceeds. In order for a computer-aided training system to 

for tool, process, or business practices, as well as orientation acquire the necessary flexibility, it should distinguish 

for different areas or lines of business. Documentation 20 between several types of students and structure the training 

modules provide on-line hypermedia documents covering material according to the students' needs and background, 

all necessary information on tool, process, process To address this problem and to provide a methodology for 

parameters, logistics and various other application and data- presenting and managing the training material to students of 

bases which the end-user (operator, technician) comes in varying background and expertise, a new multilevel student 

contact with. Certification modules provide an interactive 25 model has been developed (see FIG. 21). This new model 

knowledge based test, evaluation and feedback environ- advances a trainee's rank as the training progresses and as 

ment. CMKBs provide coordination, access control, and the trainee improves his/her certification test score, 

user management and serve as an intelligent framework for Expert technicians and operators were interviewed to 

the training and certification process. CMKBs act as a identify efficient methodologies for training the manufac- 

liaison between the trainee and the multimedia information 30 turing personnel in their area. In other words, how should the 

modules and qualification procedures. In fact, CMKBs training material be presented and managed for students of 

depict a supervisor's role, and provide control and monitor varying background and expertise? Four levels were iden- 

access to information and generate study plans according to tified: Beginner, Novice, Intermediate and Expert (see FIG. 

a student's background and progress. 21). A trainee rated as a Beginner, requires the most assis- 

A user profile database includes various information on 35 tance and step by step guidance, whereas an Expert only 

the manufacturing personnel in each area. For example, it needs to be able to locate information rapidly and efficiently, 

might include employee number, name, department, tools A student/trainee is assigned an initial level by the area 

and processes for which the employee is certified, date supervisor. The student advances to the next level 

certified, level certified (Beginner, Novice, Intermediate, (increasing responsibility and access to information) as 

Expert), and any expertise and authority level (system 40 he/she passes the certification procedure for that level. As 

administrator, production technician, maintenance the user advances, the detailed procedural information is 

technician, operator, . . . ). Any module can query the user reduced, but the conceptual and deep knowledge 

profile database directly, but the updates and modifications (declarative and procedural knowledge) of the process is 

are managed by CMKBs or directly via Graphical User increased. A Novice user knows the steps involved in the 

Interface (GUI) by authorized personnel (e.g., system 45 operation, an Intermediate student should know the cardi- 

administrator). nality and temporal relationship to the steps. An Expert user 

Active training modules provide interactive step by step would also understand the taxonomy of the tasks and 

guidance and monitor user responses and adjust/react procedures. 

accordingly. These modules usually cover the more complex Such a multilevel student model reduces the danger of 

scenarios where the system serves as an active participant in 50 trainees getting involved in potentially dangerous or destruc- 

the process, analyzes user responses and formulates a cor- five tasks which they may not have adequate training and 

responding action based on the response and the overall preparation for. In the existing training methodologies, once 

goal. Active training modules could ask trainees to perform a trainee is certified the trainee could be assigned to process 

specific tasks, examine tool components, review process products although he/she may not have had any training in 

procedures or make specific tool/process/product measure- 55 process or tool troubleshooting. In most cases, ignoring 

ments before continuing to the next step. These modules are initial signs of problems or not being able to respond to 

structured as implication networks or decision trees, and are problems quickly, could be very costly and result in tool or 

implemented as Condition Action Trees. Active training process shut down. On the other hand, in some situations, 

modules are usually used for Beginner and Novice training, initiatives by operators who have not been adequately 

where the trainee needs step by step guidance, monitoring 60 trained and informed of their responsibilities might result in 

and feedback. They are also used in dangerous situations or scraps, reworks, damaged tools and products, or an out of 

when dealing with hazardous material. spec process. In the multilevel methodology presented 

Passive training modules can also provide step by step herein, CMKB modules keep track of the user level and last 

instruction and procedures, but they neither enforce it nor certification date, along with scheduled training sessions and 

monitor the progress. Such modules are suitable for Inter- 65 topics. In addition, these modules recommend tasks suitable 

mediate and Expert users who may not require step by step for each operator and decide whether the operator should 

control and guidance and do not have to be monitored as have access to process and/or tool diagnostics. 
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To summarize, the certificatioD process is interactive and 
cooperative and is geared towards process and tool operator 
certification in general, and manufacturing operator certifi- 
cation in particular. Hie certification procedures test a train- 
ee's progress, track performance and help the trainee con- 
centrate on problem areas. The feedback and tracking 
capabilities are responsive to the concerns with existing 
certification and training procedures, which lack a meaning- 
ful and unintimidating feedback mechanism. In addition, to 
reduce intimidation, enhance learning and increase trainee 
involvement, certification is preferably expanded beyond a 
simple pass or fail. Certification modules can be considered 
an extension of training modules by providing meaningful 
feedback, suggesting topics to be reviewed and providing 
general comments, as well as constructive criticism. 

Preferably, a new user needs a password and a valid user 
Id to take a certification test. New users are assigned 
USER_LEVEL="Beginner", unless a different level is 
assigned to them by the area supervisor. Once a trainee has 
reviewed all the required materials and procedures for the 
area, tool group and level, the trainee can be given an on-line 
certification test. The test might be comprised of about 
20-50 questions (multiple choice and True/False) which 
may be answered in any order. The trainee can review an 
up-to-the-point status summary which shows the user 
responses to questions and whether a question has not been 
visited yet (Not Answered) or no answer has been selected 
for it yet (skip). Once the test is turned in, the CMKB 
evaluates the responses and generates a report. For each 
question answered incorrectly, the system lists topics, 
documents, or training modules to be reviewed. 

Tool operating and maintenance manuals, process 
documents, computer system user guides, safety and emer- 
gency procedures, and hazardous material handling and 
disposal procedures are preferably converted to hypertext 
documents and made available as part of the on-line docu- 
mentation. These documents are accessible from training 
and certification modules, as well as directly from the 
system front-end. External applications (e.g., diagnostic 
expert systems) can also utilize these documents. A docu- 
ment can be opened up to a specific topic or section. All 
documents may also be searched for a keyword or topic prior 
to opening. In case of multiple matches, it opens up to the 
first match, with the section title of all matched cases 
displayed in a selectable list box. A hypertext maintenance 
log can also be set up, so all activities related to the tool, 
process, or business practice can be logged in for shift-to- 
shift communication and long term documentation. In 
addition, periodic and long term maintenance activities, tool 
shut-downs, as well as technician/operator vacation plans 
can be scheduled and posted on this log. 

Multimedia documents and training modules can be 
designed and developed using C, Presentation Manager 
(PM), Dialogue Manager (DM), OS/2 Information Presen- 
tation Facility (IPF) tagging language, and IPF compiler 
(IPFC). Each section in the document is assigned a unique 
id (e.g.:hl res=100. Polish Ann). Then any word, sentence, 
section, image, or hot-spot in an image can be linked to this 
section using a link tag (:link reftype=hd res=100. click here 
to review Polish Arm sectiomelink.). Once the document is 
compiled, the text ("Click here to review Polish Arm 
section**) is uniquely highlighted so the user knows it is 
selectable. Pictures can also be embedded into the document 
as artwork (:artwork name o' arm.bmp' linkn , leo ^ a^m.hgl^). 
The linkfile contains the description and coordinates of 
hot-spots defined for the image. Each hot-spot can have up 
to 4 functions associated with it, which can be selected from 
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the hot-spot function pop -up menu, as shown in FIG. 22. The 
hot-spot functions menu is selected by clicking on the object 
of interest. The hot-spot functions are in fact secondary 
hot-spots within the primary, hot-spot window. These func- 

5 tions are links to other parts of the document (textual 
description, close-up picture) or to external applications to 
show an animation, display a video clip, or play audio (e.g. 
:link reftype=launch object^' audio.exe 1 data= < calibrt.aud'. 
Click here to listen to calibration procedures, relink.). 

10 One processing embodiment for creating a hypergraphic 
function pop-up menu is presented in FIG. 23. The process 
begins, 200 "Start," with a "hot spot" being defined for the 
image, 202 "Identify Hot Spot For Image," Next, a default 
hypergraphic function, such as text, close-up, video, etc., is 

15 preferably assigned to the hot spot, 204 "Assign A Default 
Hypergraphic FCT. To Hot Spot." 

Thereafter, four hot spots are defined within a main hot 
spot pop-up menu, using essentially the same procedure as 
that employed to define the main hot spot (discussed below). 

20 Each of the four hot spots serves as a menu button, and may 
comprise a square, for example, with a side length of 
approximately twenty percent the main hot spot height 
length. In the embodiment shown herein, the four hot spot 
buttons are stacked on the right-hand side of a main hot spot, 

25 206 "Define Four Small Hot Spots Within the Main Hot 
Spot." Next, hypergraphic functions are assigned to the 
small hot spots, such as text, close-up image, audio, video/ 
animation/slide show, 208 "Assign Hypergraphic FCTs. To 
Hot Spots." Preferably, hypergraphic functions are assigned 

30 in a fixed order. Finally, if one of the functions is not 
available, then the corresponding link is assigned a pop-up 
footnote with a message to that effect, 210 "If FCT. Not 
Available Provide Footnote Message." This completes pop- 
up menu setup, 212 "End." 

35 A process for creating a hypergraphic hot spot fink is next 
presented with reference to FIG. 24. Inquiry is initially 
made, 220 "Start," to ascertain whether the image is an OS/2 
bit map or metafile, 222 "Image-Bit Map Or Metafile?" If 
"no," then a commercially available conversion program 

40 such as IBM's OS/2 Image Support program is employed to 
convert the image to a bit map or metafile, 224 "Convert 
Image To Bit Map or Metafile." Once in proper format, the 
image is loaded into any commercially available image 
editor, 226 "Load Image Into Image Editor." Next, the pixel 

45 (x,y) coordinates of the lower left corner of a rectangular 
area to be defined as the hot spot are identified, along with 
the width and height of the area desired (cx,cy), 228 "Iden- 
tify Pixels (X,Y)+Width And Height Of Area (CX,CY) To 
Comprise Hot Spot." 

50 The type of action to be linked to a particular hot spot is 
then selected. For example, jump to another section of a 
document-*REFTYPE=hd, open a pop -up footnote 
window-*REFTYPE=fn, launch an external application 
A-*REFTYPE=launch, 230 "Identify Action When Hot 

55 Spot Selected." If desired a separate link file may be created, 
232 "Create Separate Link File?" If "no," then the link 
description is added immediately following the tag defining 
the image in the IPF source file, 234 "Add Link Description 
Immediately Following Tag Defining The Image In IPF 

60 Source File." Processing is then complete, 240 "End." 

If a separate link file is desired, then an ASCII Text Editor 
(commercially available) is employed to create a hyper- 
graphic link file, with an extension of an *.hgl, 236 "Use 
ASQI Text Editor To Create Hypergraphic link File." All 

65 hot spots for the image are defined with one link line per hot 
spot. Thereafter, the link file is specified in the IPF source 
file in conjunction with rartwork tag, 238 "Specify The Link 
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File In 1PF Source File In Conjunction With Image Tag." hand, it is believed essential for all operators and technicians 
When separately defined, processing is complete, 240 to have access to the training, certification, and documen- 
"End." tation applications on the workstations dedicated to their- 
Coordinating text, graphics and images in a multimedia owa workplace, rather than on some remotely-located work- 
environment is very important to effective presentation and 5 station. Therefore, alternative methods for generating and 
management of the subject matter. Some researchers have playing motion video and animation are desired, 
investigated the automatic generation of coordinated multi- resu i t ing package, referred to herein as "Poor Man's 
media. The methodology proposed herein is based on a video" (PMV), can be written in C and PM, and can be 
pre-defined presentation scenario and is implemented in one accessed from training or certification documents as an 
of the pre-defined templates (FIGS. 16*-16p). Multimedia w ^^n-controlled window, as shown below: 
documents are partitioned into "Logical Pages . A logical rr . 

page (FIG. 17) consists of a set of images and all their -hi res-999 id-videox-center y-center width-400x 

associated textual and audio description. In other words, a height-300x scroll-none titlebar-sysmemi rules=none 

logical page is the pre-defined collection of all related Me group-6, Rapitran leading/Unloading Procedure 

information (text, graphics, images, audio, animation, video :acviewport dlU'pmv' objectname=' PmvMain* 

clips, . . . ) which the trainee should/could review when Objectinfo« rapid.pnV objectid=l. 

studying the subject matter covered in that page. The PMV allows the user to specify a set of OS/2 bitmaps as 

appearance, format, and access to logical pages are fixed and video frames and specify a global frame delay (1-99999 ms) 

consistent throughout the system. Logical pages are related or specific frame delays for each frame or a group of frames 

to each other via hypertext and hypergraphic links. To (FIG. 25). About 45 frames per second (256 color 300x400 

accommodate all possible situations and to maintain con- 20 pixels frame) can be achieved on an IBM Model 95 PS/2 

sistency among various multimedia modules developed in a (486Dx2) with 32 MB RAM, with an initial load time of 7 

organization, the library of "Logical Page Templates" is seconds. The PMV's graphical front-end (FIG. 25) allows 

provided (FIGS. 16a-16p). application developers to create video and animation clips 

Many users of a multimedia training system such as quickly and efficiently, 

described herein will not be sophisticated computer users, PMV can generate either a "run-time" PLB (PMV Library 

and too many features (options, menus, controls) could be Block) or a "compile-time" PLB. Compile-time PLBs are 

confusing, and in some cases restrict the amount of control self-contained and can be exported to other workstations 

and access that CMKB modules need to preserve. For without any need for copying the images or having access to 

example, if the users are allowed to minimize training them. Run-time PLBs, on the other hand, contain pointers to 

applications, the system would not be able to control the 30 the images used in the video clip or animation and therefore 

number of copies opened and would not know whether a require access to these. In some cases, images are used in 

task has been completed. more than one animation or video clip. Run-time PLBs are 

In addition to the logical page templates described above, more efficient in such cases since these are generated and 

most of the major attributes of a logical page can be loaded at run-time. Thus, a single copy of the frames to be 

customized (FIG. 19). For example, page background color, 35 used in animation or video clip only needs to be stored, 

highlight color, logical page size and position, text style and When an animation or a video clip is launched, the run-time 

font size, pull down menus and menu items, system menu PLB loads the images on the fly, which could be time 

items, push buttons, vertical and horizontal scrolls, min/max consuming for long video clips (about 1 second per frame 

icons, window titles, etc. clip on a 486 PS/2 with 32 Meg RAM). In addition, the 

Multimedia in general, and motion video, animation, and 40 launch would fail for run-time PLBs if the images cannot be 

audio in particular, are believed to be appealing to manu- located (moved or renamed). On the other hand, there is the 

facturing personnel involved with maintenance, diagnostics, storage overhead associated with compile-time PLBs since 

and training. However, in many cases the cost and logistics images have to be replicated and stored locally Accessing 

of required hardware and software is a major concern. large PLBs over the network is slow and unpredictable. 

Remember that most manufacturing facilities include tens 45 PMV has two main portions, namely, a compile/generate 

and even hundreds of workstations. Training, certification video and a play video function. There are four components 

and on-line documents have to be installed on a large to implement these functions. These are: 

number of these workstations. If an application requires PMBC.exe-*compiler 

special hardware or software license, the cost would become ^ pjy[V DLL-*player 

a significant roadblock. Although cost is a major concern, • * /tui i\ 

7L ui • u* u *u t i f -i ui ^ *.PMV-*video script file (Table 1) 

another problem might be the lack of any available expan- r \ / 

sion slot on some workstations in the area. *.PLB-*video library block 

It is not practical to expect or justify upgrading all Video script is defined in either of two ways. Script can be 

workstations with a video card (e.g., IBM's M-motion defined manually via any text/ASCII editor or automatically 

adapter card for motion video), Video Capture Adapter (for 55 via a PMV graphical front-end interface as described above, 

digitizing and storing of compressed video images), and the By way of example, PMV video script language format is 

Audio Capture and Playback Adapter (ACPA). On the other defined in Table 1 below. 



TABLE 1 

* This .pmv file contains the description of the video clip you are creating. 

* Each line has 5 fields 

* 1) Frame BMP full path, 2) a unique frame id, 3) frame delay in ms 

* 4) Frame group id (if any), 5) Group # of repetition 

* Complete this file then compile it to create adl.plb. 

* pmvc adl.pmv e:\projects\adjl\adl.plb 
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TABLE 1-continued 



* adj.plb is used in the ipf as shown below: 

m :acviewport dll = 'PMV objectname » TmvMain' objectinfo » 'adl.plb' 

* objectid - 1 

* play the following frames for 300 ms 
e:^>rojects\adl\adll.bmp 1 300 0 0 
e:\projects\adl\adl2.bmp 2 300 0 0 
e:\projects\adl\adl3.bmp 3 300 0 0 
e:Vroject8\adl\adl4.bmp 4 300 0 0 

* define and repeat the group #1, 3 times, for 200 ms 
e:\projects\adi\adl3-bmp 1 200 1 3 
e:\projects\adl\adl4.bmp 2 200 1 3 
e:\projects\adl\adl3.bmp 3 200 1 3 
e:Vrojects\adl\adl4.bmp 4 200 1 3 

* define and repeat the group #2, 3 times, for 100 ms 
e:\projects\adI\adl3.bmp 1 100 2 3 
e:\projects\adI\adl4.bmp 2 100 2 3 
e:\projects\adl\adl3.bmp 3 100 2 3 
e:\projects\adl\adl4.bmp 4 100 2 3 

* define and repeat the group #3, 3 times, for 50 ms 
e:\projecte\adl\adl3.bmp 1 50 3 3 
e:\projects\adl\adl4.bmp 2 50 3 3 
e:\projects\adl\adl3.bmp 3 50 3 3 
e:\projects\adl\adl4.bmp 4 50 3 3 

" define and repeat the group #4, 20 times, for 5 ms 
e:\projects\adl\adl3.bmp 3 5 4 20 
e:>projects\adl\adl4.bmp 4 5 4 20 
* 

* define and repeat the group #5, 20 times, for 50 ms 
e:\projects\adl\adl3-bmp 3 50 5 20 
etyrojects\adl\adl4.bmp 4 50 5 20 

* define and repeat the group #6, 20 times, for 150 ms 
e:\projects\adl\adl3.bmp 3 150 6 20 
e:\projects\adl\adl4.bmp 4 150 6 20 



FIG. 26 depicts the process in greater detail. As noted, a 
user employs either an ASCII editor or the PMV front -end 
300 to define a PMV script file 302, referred to herein as 
*.PMV (See Table 1). 

The compiler, PMVC.exe 304 then takes the PMV script 
file and compiles it into either a compile-time video library 
block 306 or a run -time video library block 308. The player, 
PMVDLL310, then retrieves either the compile-time library 
or the run-time library, and repeats each frame by the global 
delay, e.g., 300 msec, i.e., unless a specific frame delay is 
specified otherwise. The player presents the PMV within a 
video window in a logical page 312. Detailed embodiments 
of the above-described processing are presented in FIGS, 
27-28. 

Referring first to FIG. 27, the compiler, 320 "PMVC.exe," 
initially reads the ASCII video script file, 322, "Read * .PMV 
Script File." A unique identifier is then assigned to each bit 
map based on order of appearance, 324 "List And Tag All Bit 
Maps Id Order Of Appearance/' The video script is then 
flatten and saved as a header in the video library block 
*.PLB in addition to loading the appropriate bit maps into 
the library or the bit map addresses depending upon whether 
compile-time or run-time is desired, 326 "Flatten Script And 
Save As Header Of * .PLB. Generate Pointers To Bit Maps." 

Next, the compiler determines whether run-time or 
compile-time is desired, 328 "Compile-Time?" If "yes," 
then inquiry is made whether compression is needed, 332 
"Compression?" If again "yes," each bit map is compressed 
and appended to the bottom of the play file VPLB, 334 
"Compress Each Bit Map And Append To The Bottom Of 
*.PLB With No Spacing." If compression is unnecessary, 
then the bit maps are appended to the bottom of the * .PLB 



file directly, 336 "Append Bit Maps To Bottom Of *.PLB." 
Alternatively, if run-time is desired, then the bit map 
addresses are appended to the video library block, 330 
"Append All BMP Addresses To *.PLB " Compilation is 

40 then complete, 340 "End." 

One processing embodiment of a PMV player is depicted 
in FIG. 28. As shown, the player, 350 "PMV.DLL " initially 
reads the video library block header and obtains the bit map 
pointers and delay parameters, 352 "Read The *.PLB 

45 Header, Bit Map Pointers And Delay Parameters." Next, the 
player determines whether the file comprises compile-time 
or run-time information, 354 "Compile-Time?" If compile- 
time, the bit maps appended to the video library block are 
read directly according to the bit map pointers and loaded 

50 into memory, 356 "Read Bit Maps Appended To *.PLB File 
According To Pointers." If run-time, then the bit map 
addresses are read from the video library block and loaded 
into memory, 358 "Read Bit Map Addresses Listed In 
*.PLB." 

55 Processing next determines whether compression of the 
bit maps has occurred, 360 "Compression?" If "yes," then 
the bit maps are decompressed, 362 "Decompress Bit 
Maps." Thereafter, the bit maps are loaded into memory, 364 
"Load Bit Maps Into Memory." 

60 The header information is next converted into bit map 
pointers and bit map delays, 366 "Convert The Header Bit 
Map Offset Pointers To The Memory Offsets Of The Bit 
Maps." The player then iterates through the video display 
list displaying the bit maps for the specified time, 368 

65 "Iterate Through List And Display Bit Maps For The Time 
Specified In Corresponding Delay Parameter." The process 
is continued until the user or the application closes the video 
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window or the logical page, 370 "Video Window Or Logical 
Page Closed?" If "yes," playing is complete, 372 "End/* 

PMV can be used for pseudo animation using graphic bit 
maps or still images with 500 ms to 1 second of frame delay. 
Alternatively, a true animation tool from IBM called AnDes 5 
(Animated Design) can be used, which allows animated 
models to be created using Excelerator, marketed by Inter- 
solv Inc. of Rockwell, Md., based on Ward & Mellor 
methodology Parameswaran, T, "Structured Design of Real 
Time Systems/' Proc. of National Workshop on Software 10 
Reliability Engineering, WSRE92, (1992), which is based 
on transformation graphs and state transition diagrams. 
Excelerator models are then converted to AnDes format, 
before they can be animated. Although AnDes offers a true 
animation capability, in most cases use of PMV is believed 15 
preferable to avoid the overhead associated with installing 
Excelerator, AnDes, and Prolog for creating and performing 
animation. 

Although specific embodiments of the present invention 
have been illustrated in the accompanying drawings and 20 
described in the foregoing detailed description, it will be 
understood that the invention is not limited to the particular 
embodiments described herein, but is capable of numerous 
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rearrangements, modifications and substitutions without 
departing from the scope of the invention. The following 
claims are intended to encompass all such modifications. 
I claim: 

1. An inferential processing method for an expert system 
having a knowledge base with a hierarchical decomposition 
of three levels, an uppermost level comprising a behavioral 
knowledge level, a middle level comprising a structural 
knowledge level, and a lowermost level comprising an 
action level, said processing method comprising the steps of: 

(a) inference processing within said behavioral knowl- 
edge level based upon entropy values associated with 
nodes within said behavioral knowledge level; 

(b) subsequent to said step (a), inference processing 
within said structural knowledge level with reference to 
entropy values associated with nodes within said struc- 
tural knowledge level; and 

(c) subsequent to said step (b), inference processing 
within said action level using entropy values associated 
with nodes with said action knowledge level. 

♦ + * * * 
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